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(57)Abstract 

Color and luminance measurement signals produced by the multiple sensors of a multiband (e.g. RGB color) image signal 
processing system are processed to reduce noise. For images such as those obtained from a multi-dye film, the lummance compo- 
nent of the output signal from the luminance sensor may be expressed as a function of the color components of tiic color sensor 
output signals. A first signal, representative of the constructed low frequency luminance signal, is produced as a linear function 
of the color sensor output signals, employing signal weighting coeffidents derivable from intrinsic characteristics of the stunned 
image, such as the respective dye densities of a tiirce layer color film. The luminance measurement signal denved from the lumm- 
ance sensor is subtracted from this first signal, to produce a second signal, which is multiplied by a set of respedtive scalmg fac-. 
tors, which are tiicn subtracted from each color sensor output, so as to derive a set of noise-reduced estimates of the color compo- 
nents of each of the color sensor output signals. Each scaling factor is defined in accordance with the noise variances assoaated 
witii the operation of the color image sensors and the luminance image sensor, and is proportional to a product of a correspond- 
ing one of the coefficients and tiie ratio of the noise variance associated witii tiie operation of a respective color image sensor to a 
summation of the noise variances associated with the operation of each of the color sensors and the lummance sensor. 
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METHOD FOR DERIVING NOISE-REDUCED ESTIMATES OF COLOUR SIGNAL PARAMETERS 
FROM MULTIPLE COLOUR/LUMINANCE IMAGE SENSOR OUTPUTS 

5 FIELD OF THE TWEKTriON 

The present invention relates in general to 
color imagery signal processing and is particularly 
directed to a mechanism for. deriving noise-reduced 
color signal estimates from a multiple sensor color 
10 imaging system. 

BACKGROUND OF THE INVENTION 

Multi-channel signal processing systems often 
contain a larger number of sensors than there are bands 

15 of information to be extracted. Namely, they may be. 
characterized as containing n sensors for deriving m 
bands of information, where n>m. For example, a color 
imagery sensing system, such as employed for high 
definition television, may, on occasion, contain four 

20 image sensors, three of which provide relatively low 
spatial resolution measurements of the red, green and 
blue components of an image, such as the red (R) , green 
(G) and blue (B) density of a color film, while the 
fourth sensor provides a relatively high spatial 

25 resolution, luminance-representative (L) output signal. 
A low spatial frequency luminance signal is generated 
by resampling the original high resolution luminance 
. signal, so as to replicate the resolution at which the 
red, green and blue signals are measured. Subtracting 

30 this low frequency luminance from the original 
luminance signal yields only its high frequency 
component. (Aside from this subtraction step, the low 
frequency Iximinance information is not used.) The 
resulting high frequency component is then added to the 

35 red, green and blue signals to produce high frequency 
information for these channels. 
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Due to the imperfect nature of the sensors, 
each output signal inherently possesses some degree of 
sensor- induced noise, so that the output may be 
expressed as the sum of an intended parameter p^, plus 
5 a noise component npi associated with the sensor's 

measurement of that parameter. . Consequently., reducing 
the magnitude of this noise, conponent would enable the 
system to provide a more faithful reconstruction of its 
input image, Fortunately, since a typical film strip - 
10 contains only three dyes, the system is essentially 
measuring the values of three parameters (dye 

densities) on the basis of four measurements (red, 

-J 

green blue and luminance transmittances) . Moreover, 
even when the system, is making measurements on a scene ■ 

15 which contains a full spectrum of colors (e.g. the real 
world), because the spectral sensitivity of. the 
Iximinance sensor usually overlaps that of the other 
sensors (e.g. RGB color sensors), the (low frequency) 
luminance component will contain information that is 

20 related to the parameter measurements in the color 
sensor outputs. 

SUMMARY OF THV. jmrvt^jn^ - 

In accordance with the present invention, 

25 advantage is talcen of. this additional source of 

information in the low frequency luminance signals, so 
as to reduce the noise in the cpior signals output by 
the color sensors . More particularly, the present 
invention is directed to a. multiband (e.g. R,G,B,L) 

30 image signal processing system having a plurality of 
color image sensors, each of which produces a 
respective color output signal that contains a 
respective color representative component of the image 
and a noise component associated with' the '^operation of ' 

35 the color sensor through which its output signal is 
produced. For images such as those obtained from th6 
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above- referenced three layer film, the luminance 
component of the output signal from the luminance 
sensor may be expressed as a function of the color 
components of the color sensor output signals. Namely, 
5 the luminance sensor output L may be expressed as the 
sum of a function f (r,g,b) and the luminance sensor 
noise nj,, where r, g and b are the color components 

within the color sensor outputs for which reduced-noise 
estimates are desired. 

The signal processing mechanism according to 
the present invention processes a vector ci of inputs 
(intrinsic parameters) and a vector c© of measurable 
outputs, related by a function Cq = F(ci) which may, in 
some cases , be approximated by a matrix Cq = Aci . For 
15 a four sensor color imagery processing system, sensor 
outputs are processed to reduce the. noise components in 
the color sensor output signals and thereby derives 
.. noise- reduced estimates of each of the color components 
within these sensor output signals. To this end, a 
first signal, SI, which is. representative of the low 
frequency luminance signal, is produced as a linear 
function of the color sensor output signals, in the 
form SI = (AR + BG + CB) , where A, B and C are signal 
7 weighting coefficients derivable from intrinsic 
.... 25 .. characteristics of the scanned image, such as the 
^.'.::....\'..::,::^^^■,respecti^re dye densities of a three layer • color film; ' 
■ ■ " ' The Ivuninance measurement signal derived from 'the ' 

is .subtracted from this first signal 

S2: Vitiis second' signai .V . 
- ^2 ^^^^ multiplied by a set of respective scaling 

.. factors, which are then subtracted from each color- 
sensor output, so as to derive a set...of noise-reduced 
i ..^. .^^^"^^^^ color components of each of the color . 
sensor output signals. Each scaling factor is defined 
i : the noise variances associated with ■ ' 

the operation of the color image sensors and the 



20 
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luminance image sensor, and is proportional to a 
product of a corresponding one of the coefficients A, B 
and C, and the ratio of the noise variance associated 
with the operation of a respective' color image sensor 
5 to a summation of the noise variances associated with 
the operation of each of the color sensors and the 
liiminance sensor. 

PRTPF DESCRIPTION OF THE DRAWTNfi.q 
^0 "Ehe single Figure diagrammatically shows a 

color image processing system employing multiple image 
sensors and a dedicated color signal processor. 

DETAILED DESCRTPTTOM 

15 . Before describing the details of an 

embodiment of the present invention, it should be 
observed that the invention resides primarily in a 
novel color signal noise reduction mechanism, rather 
than a particular implementation of that mechanism. 

20 Moreover, although, in its preferred embodiment, the 
invention is implemented using a programmed digital 
computer, the noise reduction mechanism may be carried 
out by means of a variety of structural combinations of 

conventional .signal processing circuits and components, 

25 such as custom- configured integrated circuit hardware. 
Accordingly, the structure, control and arrangement of. 
the signal processing hardware of an embodiment of the 
invention have been illustrated in the drawings by a 
readily understandable block diagram, which .shows, only 

30 those specific details that are pertinent to the 

present invention, so as not to obscure the disclosure 
with structural details which will be readily apparent 
to those skilled in the art having the benefit of the 
present description. 

35, Figure 1 illustrates an exemplary application 

of the present invention to a signal processing 
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environment that employs a first plurality of n 
measurements on a second plurality of m intrinsic 
variables. Specifically/ for purposes of the present 
description, the environment is that of a multi-color 
5 image processing system which carries out n=4 

measurements on m=3 intrinsic variables and comprises a 
(multiple sensor) color image section 10, containing 
red, green, blue and luminance sensitive sensors 13R, 
13G, 13B and 13L arranged on one side of a three layer 
10 color film strip 15, that is illuminated by light 
source 16 having a spectral light intensity 
Situated in front of the sensors are respective input 
filters 17R, 17G, 17B and 17L, having respective 
transmittances T^U), Tg(k) , Tfe and (X) , Each 

15 sensor produces image characteristic^representative 
digital signals, i.e. respective red, green, blue and 
Ixjminance channel signal values representative of the 
red, green, blue and luminance components of a color 
image 23 captured on film strip 15 which are coupled 
20 over links 21R, 21G, 21B and 21L to a processor 30. 

As pointed out above, in the course of 
operation. of such a multi-channel (e.g. three color 
band, Iximinance band) image scanning system, the color 
channel sensors 13R^ 130/ 13B provide relatively low 
25 spatial resolution measurennents of respective red R, 

\ 9rBen G and blue B .components of the film, such as its > 
i''^^^^ 9^^^ and ;;blue "densities, vrti^ 
. luminance sensior 13L provides a , relatively high . 
spatial resolution Ivmnance representative output 
V'30v . .signal:^: A low spatiair frequency' liiminahce signal is 
.generated by resampling the original high resolution 
^liminance signal, so as to replicate the resolution at 
which . the red, green and. blue signals are measured. 
: . . t^is low frequency luminance from the 

35 original luminance signal yields only its high 

frequency component. The resulting high frequency 
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coinponent is then added to the red, green and blue 
signals to produce high frequency information for these 
channels*. 

When film strip 15 is scanned by system 10, 
5 the output signals produced by the respective color and 
luminance sensors 13R, 13G, 13B and 13L contain noise 
components that are associated with the operation of 
the sensors themselves. Namely, these noise components 
are effectively independent of the image and therefore. 

10 constitute signal processing anomalies that prevent a 
true reconstruction of whatever coirprises the original 
image as seen by the imaging system. The object of the 
present invention is to correct or reduce these 
inserted errors; it does not serve to correct flaws in 

15 the original image (within film strip 15). 

In terms of signal definitions, each color 
sensor output may be expressed as the sum of an 
intended parameter Pi, plus a noise component np^ 

associated with the sensor's measurement of that 

20 parameter. Consequently, reducing the magnitude of 

this noise coinponent will enable the system to provide 
a more faithful reconstruction of its input image. 
Fortunately, since film strip 15 typically contains 
only three dyes, the system is essentially measuring 

25 the values of three parameters (dye densities) on the 
basis of four measurements (red, green, blue and 
/ luminance transmittarices ) . Moreover, the ( low 

frequency) luminance component L contains information 
that is related to the parameter measurem in the 

30 color sensbr odt^j^iits. -y: >■ v : 

As. noted above, pursuant to the present 
invention, advantage is taken of this additional source 
of information in the low frequency luminance signals, 
to reduce the noise in the. color measurement signals R, 

35 G and B output by color sensors 13R, 130 and 13R. In 
order to facilitate an understanding of the signal 
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processing mechanism of the present invention, it is 
useful to initially define the signal outputs of each 
of sensors 13 of scanning system 10. Specifically, for 
an arbitrary pixel within each sensor, R, G arid B 
5 denote the signals measured by the red, green and blue 
sensors 13R, 13G and 13B, respectively, and L denotes 
the low frequency luminance signal (for the same pixel 
location) for the measured ' luminance signal. The 
signal values R, G, B and L may be defined as: 



10 

R = r+n^, (1) 

G = g+ng, (2) 

B = b+nfe, and (3) 

L = f(r,g,b)+nL (A) 

15 



(Note that this model set of definitions is appropriate 
for scaiining a three- layer film, , but not for looking 
at real-world scenes.) Here each noise value n^ is an 

independent observation noise which is normally 
20 distributed with zero mean and variance c^± (a^L is the 

effective noise variance of the noise in the low- 
frequency liaminarice signal). The r, g, and b 
parameters are the "true" or noise-free red, green and 
blue transmittances. The function f is the 

25 (deterministic) relationship between the red, green and 
blue transmittances and the (low- frequency) liaminance 
transmittance. An implicit expression for the function 
f may be obtained by considering the details of the 
scanning process; 

30 The scanner uses a light source 16 (with 

spectral intensity HX) shining through film 15 
containing three color layers with dye densities di, d2 
and d3. The optical densities of these dyes, as a 
function of wavelength, are DiiX) , D2(X) and D3 (X) • 

35 Finally, sensors 13R, 13G, 13B and 13L look at the 
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transmitted light through respective filters 17R, 17g, 
17B and 17L with transmittances Tj-iX) . Tg(X). T^iX) and 
Tl{X). If sensors 13R. 13G, 13B and 13L produced 
noise-free output signals, the respective light 
5 intensities that would be measured are: 



10 



r = J i(X)lO-2:idiDia)Tj.a)dX, (5) 

g = J ia)10-3:i'3iI>ia)Tg(X)dX. (Sj 

b = J I(>.)10-2:idiDia)Tb(X)dX, and (7) 

f(r,g,b) = J ia)10-:Ei<3iDia)TL(X)dX. ....... (8) 

15 The dye densities di of film 15 are derived hy .solving 
the equations (5). (6) and (7) and then are used in 
equation (8) to determine the value of f . For general 
spectral characteristics, this non-linear equation (8) 
is the simplest expression for f. However, if the 

20 effective filter for the luminance channel is, a linear 
combination of the effective filters for the red. green 
and blue channels, then f (r,g,b) is the same linear 
coiribination of r, "g and b. . \ 

From the sensor measurements for R, G, B and 

25 L. the parameters r, ;g and b are to" be estimated From 
the previous analysis, the maximum likelihood (ML) 
estimate for the parakieters is that set^ of values of r, 
g and b which maximizes: 

30 - -{R-f)2/a2^. (G-^,/a2g:(B-6)2/t^j;^(L^f (A.^ r 



35 



Obviously, excluding the knowledge of L gives ML 
estimates of r. g, and b as the measured values R, G, 
B. respectively, when the L term is included, the ML 



estimates r. g, and b satisfy the equations: 
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r = R-(o2^/a2L) (f (r,g,6)-L). df /dr(r,g,b) , , . . (10) 
g = G-(a2g/a2L) (f (r,g,b)-L) , df /dg(r,g/b) , and . (11) 
h ^ B-«5\/a\) (f{r,g/h)'L) . df /db(r,g,b) , . . . (12) 



For a general fxinction f, equations (10), 
(11) and (12) will be non-linear and will not have a 
10 closed form solution. If the function f is linear in 
its arguments, however, its solution can be obtained. 
Thus, if it is assiamed that: 



15 



f (r,g,b) = ar + pg + Yb . . . (13) 

Then, equations (10) , (11) and (12) , respectively, 
become: 

r = R-(ar+pg+Y6-L)a(a23./a2L) . (14) 

g = G-(ar+pg+Yb-L)'P(a2g/a2L) . (15) 

b = B-(ar+pg+Yi>-L)Y(a2i5/a2L) (16) 



"25 for which the solution is; 



20 



/ V r T^ . ; . . . % V .... : . .V(17) 

b = B" ((xR+p<3+YB^L)Y(c2]^/a2^) • i." • • . . (19) 

; vrtiere: . . 

, ^: O^T.r ^-^^ ^^^^r ^ P^^^g + Y^^^^b • • • • • • • • v (20) , 
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Equations (17), (18)^and (19) reveal that each of the 
values for r, g and b is simply the original 
measurement for its channel, corrected by a fixed * 
fraction of the quantity' (aR+pG+YB-L) which is the 
difference between the luminance signal and a luminance 
signal constructed from the red, green, and blue 
measurements . 

The rms error of the estimate r is: 

o\(i-a^o2^/o^T.) ^2iy 



which is strictly less than <y2j, (with corresponding 
expressions for the error of g and b, so that it can be 
seen that an iinprovement can be made in the noise 

15 characteristics of the measurements. 

This improvement in the noise of the red, 
green, and blue signals also extends to linear 
combinations (e.g. differentials) of these signals 
(such as an R-Y or B-Y signal) . Generating the linear 

20 combination M, directly from the measurements R, G and 
B as: 

M = qR + sG + tB ..... .\ (22) 

25 yields an rms error of : 

o^l =^ q2a2j. + s^o^g + t^o^i^ . . . (23) 



However, if the combination is defined as: 



A /\ A 

M = qr + sg.+ tb . (24) 
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then the rins error of the estimate becomes (after 
algebraic simplification) : 

= crV(aqa2j.+psa2g+yta2b)2/a2^ (25) 

5 

which is always the better estimate. 

In accordance with a preferred embodiment, 
the system will not be light-limited, so that the noise 
level from each sensor will be the same. The low- 
10 frequency luminance signal is obtained by averaging 
four luminance measurements, so that its rms noise is 



half that of the other channels {0^ - Cg = = 2uj^y . 
For exemplary parameters a = . 3 , p = . 6 , and y = . 1 , 
equations (17), (18) and (19) yield: 

15 

r = R-.42A with = (,93)03:/ . (26) 

g = G-.85A with = (.70)ag, and (27) 
20 b = B-.14A with afi = (.99)0^, .......... (28) 

where: 

A = .3R + .6G + .IB = L . . . . . (29) 

■25"^'-^ • ■ ; ' ' ' _ ' ■ ' ■ ■■ ' ■ ' " ' '■ " 

\;:By„ slightly modifying the coefficients to: a = .4, 



• ' ' * the values of r, g and -S^become: ; 

g = G-.75A with .= (.79)Og, and . ..... . , . . (31) 

^ . b = B-.15A with = (,99)ab, . .. .. . . . . (32) 
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where : 

A = .4R + .5G + .IB - L . . . 



(33) 



The most significant reduction in noise is in the green 
channel, where a 20-30% iirproyement in SNR can be 
obtained. 

The linear definition for f used here holds 
only correct if the effective spectral transmittance of 
the luminance channel is a linear combination of the 
effective spectral transmittances of the red, green, 
and blue channels, if this is not the case, then f is 
the more conplicated function given above and depends 
on the spectral characteristics of the light source and 
15 the film dyes; the improvement in SNR will also be 
signal-dependent. 

It should be recalled that the noise being 
discussed here is the noise signals produced by the 
sensor, i.e., measurement noise. That is, the computed 
values are estimates of the transmittances through the 
film strip 15 in the absence of measurement noise, but 
any noise in the film (e.g. grain) is considered to be' 
part of the signal. In practice, the desired 
quantities are the signals which gave rise to the film 
25 record, prior to any film noise being added to the 
signal- Since the measurement of blue transmittance 
contains blue 'film .noise and this measurement is now 
used to compute , the green and red estimates of • 

J^^^fJ^ is the concern; that, for. example, 
^^'a^rioisy blue lay e^^^^^ the 'f iliri will^^^^^ extra noise to' 
the green and red estimates. However, it turns out 
that' this is not the case. . * 

More particularly, with reference to the 
, above-described linear approximation, r, g and b 
35 correspond to the respective red, green and blue film 
^ transmittances, in the absence of both film and 
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measurement noise* If the film noise (kj-^kg^kb) is 
additive in intensity space, then the measurements may- 
be defined as: 



5 R = r + kj; + nj., , . . (34) 

G = g + kg + ng, (35) 

B = b + kb + n^, and (36) 

L = a(r+kr) + p(g+kg) + y(b+kb) + hl (37) 

10 If the film noise is additive in density space, the 
definitions are: 

R = rlO^t^^ + n^., , . , (38) 

G = glO^s + ng, _ . (39) 

15 B = blO^ + Hb, and (40) 

L = a(rlO^) + p(gl0^9) + Y(blO^) + nj, (41) 



In both cases the maximiam likelihood estimators are 
unchanged from the simpler case discussed previously. 
20 Consequently, for the additive in intensity space case, 
the expression for r becomes: 

r = R-(aR+pG+YB-L)a{a23-/a2,p) . . . (42) 
= r+kr+n^- (an3^+Png+7nb-nL)a(a23./a2,p) ...... (43) 

25 

Similar expressions may be derived for g and b. It 
' should be observed that " contributions of kg and kb to r 

. come from L as well as from G and B, but that these 
_ contributions cancel. Thus,, the only increase in the 
30 ■ " rms error of r is the iexpected contribution from the 

film noise in the red layer. The same result holds for 
the case of noise which is additive in density space, 
and it also holds for linear combinations of red, green - 
and blue signals. That is, ; : 
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a2A = a2k^+a2j.(l-a2CT2j./a2T) (44, 

= <^\g*o2g(i.p2a2g/a2^) ^^^^ 

5 a2g = a2kb+o2b(l-Y2a2b/a2T) . (4gj 

= q2 {a2krH-cy2r)..s2 (or2j^g^a2g) .t2 (a2kb^-a2b) , and (47) 
= o2M-(aqa2r+Psa2g+7ta2b)2/a2T (43) 

10 . 

CQNrr.TTC!Tn]J,g 

As will be appreciated from the foregoing 
description, in accordance with the signal processing 
mechanism of the present invention, a reduction in 

15 noise is possible in a multi-band (e.g. multi-color 
imagery) signal processing system by using the 
information contained in a plurality of n observed 
measurements y (e.g. R,G,B,L sensor outputs) related to 
la intrinsic^^par^eters ^ (e.g. color components) by the 

20 expression y = A x. The components of ? are rescaled 
by the measurement noise ai in the measurement yi- 
Letting yi' = y^/ai and A'i^ = Aijai, so that y- = A'x 
and the measurement error in each measurement of y> is 
1.0, then , given a measurement ^ ' , the best estimate of . 

25 the intrinsic parameters x is: 



.30 



X = [(A'+A- )-lA'+]y' 



• (49) 



The braclceted quantity in equation, (49) , depends : only - 
upon system characteristics and th^ ^h^a noise 
level. It reduces to equations (17) - (19) for the 
special case described above. 

Thus, in the above-described example of a 
multi-color imaging processing system the low- frequency 
35 luminance signal is used in combination with the red. 
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green, and blue signals. The actual magnitude of the 
reduction depends on the relative noise levels in the 
different sensors and on the details of the 
relationship between the luminance signal and the three 
5 color signals, (In the exemplary, but realistic case, 
a reduction of green measurement noise by 20-30% can be 
obtained.) If the graininess of the film is included 
in the noise considerations, the proportional reduction 
in noise will be smaller, but there are no 

10 contributions to noise in one channel due to film noise 
in another. 

While I have shown and described an 
embodiment in accordance with the present invention, it 
is to be understood that the same is not limited 

15 thereto but is susceptible to numerous changes and 

modifications as known to a person skilled in the art, 
and I therefore do not wish to be limited to the 
details shown and described herein but intend to cover 
all such changes and modifications as are obvious to 

20 one of ordinary skill in the Art, 
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WHAT IS CT.RTMFp> 

1. For use with a multiple band image ' 
sensor system having a plurality of first image 
5 sensors, each of which produces a respective first 
sensor output signal that contains an information 
component representative of a respective characteristic 
of said image and a noise component associated with the 
operation of the sensor through which its output signal 

10 is produced, and a further image sensor that produces a 
further sensor output signal containing an information 
component representative of a further characteristic of 
said image, and which is expressible as a function of 
the information coirponents of said first sensor output 

15 signals, and a noise component associated with the 
operation of said further image sensor, a metht)d of 
processing said first and further sensor output signals 
to reduce the noise components in said first sensor 
output signals and thereby derive noise-reduced 

20 estimates of each of the information components within 
said first sensor output signals comprising the steps 
of: 

(a) generating a first signal, 
representative of said further image sensor signal, as 

25 a function of said first sensor output signals; 

(b) generating a second signal 
representativiB of a prescribed relationship between '"\ 
said first signal and said further sensor output 
signal; and 

(c) combining the first sensor output 
signals produced by said first image sensors .with said 
second signal generated in step (b) , to obtain said 
noise-reduced estimates of the information components 

- of each of said first sensor output signals. 
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2. A method according to claim 1, wherein 
step (b) coirprises generating said second signal as the 
difference between said first signal and said further 
sensor output signal. 

5 

3 . A method according to claim 2 , wherein 
step (c) comprises subtracting a fraction of said 
second signal from each of said first sensor output 

. signals to thereby obtain said noise-reduced estimates. 
10 of the information components of each of said first 
sensor output signals, 

4. A method according to claim 1/ wherein 
step (c) includes generating a plurality of third' 

15 signals representative of the noise variances 

associated with the operation of said first image 
sensors and said further image sensor/ and combining 
the first sensor output signals produced by said first 
image sensors with the second signal generated in step 

20 (b) and said plurality of third signals, to thereby 

obtain said noise-reduced estimates of the information 
components of each of said first sensor output signals. 

5. A method according to claim 4, wherein a 
25; respective one of said third signals is representative 

- ; of the ratio of the noise variance associated with the 
* . o^ respective first iinage sensor to a 

summation of the noise variances associated with the 
...operation. of said plurality of first, image sensors and; 
30 * said further image sensor. 

6. A method according to claim 1, wherein 
said plurality of first image sensors produce first 

- sensor output signals associated with respectively 
35 different color components of an image, and wherein 

step (a) . comprises generating said first signal as a 



BNSDOCID: <WO 9109493Al_L> 



wo 91/09493 



PCr/US90/07142 



-18- 

linear fxinction of the respectively different color 
representative first sensor output signals, 

7. A method according to claim 6, wherein 
5 said further image sensor produces said further sensor 

output signal in accordance with a luminance component 
of said image, and .wherein step (b) conprises 
generating said second signal as the difference between 
said first signal and said luminance component 
10 representative further sensor output signal. ' 

8. A method according to claim 1, wherein 
said plurality of first image sensors produce first 
sensor output signals R, G and respectively . * 

15 associated with red, green and blue color components of 
an image, and wherein step (a) comprises generating a 
first signal SI as a linear function of the respective, 
red, green and blue color representative first sensor 
output signals, in accordance with the relationship: 

SI = aR + bG + cB, 
where a, b and c are prescribed coefficients. 



20 



9. A method according to claim '8, wherein 
said further image sensor produces a further sensor 

25 output signal L in accordance with a luminance 

component of said image, and wherein step (b) conprises 
generating a second signal S2 as the difference between 
said first signal Si and said luminance component : 
. : representative . further sensor output signal L. 

10. A method according to claim 9, wherein 
step (c) includes generating a plurality of third 
signals S3, a respective one of which is representative 
of the ratio of the noise variance associated with the 

35 operation of a respective first image sensor to a 

s^™^tion of the noise variances associated with the 
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operation of said plurality of first image sensors and 
said further image sensor, and combining the first 
sensor output signals R, G and B produced by said first 
image sensors with the second signal S2 generated in 
5 step (b) and said plurality of third signals, to 
thereby obtain said noise-reduced estimates of the 
information components of each of said first sensor 
output signals. 

^0 11. A method according to claim 10, wherein 

a respective third signal, a.ssociated with one of said 
color coitponents, is proportional to a product of a 
corresponding one of said coefficients and the ratio of 
the noise variance associated with the operation of a 

15 respective first image sensor to a summation of the 
noise variances associated with the operation of said 
plurality of first image sensors and said further image 
sensor. 

20 12. For use with a multiple band image 

sensor system having a plurality of first image 
sensors, each of which produces a respective first 
sensor output signal that contains an information 
component representative of a respective characteristic 

25 of said image and a noise component associated with the 
operation of the sensor through which its output signal 
is produced, and a further image sensor that produces a 
further sensor output signal containing an information 
component that is representative of a further* 

30 characteristic of said image, and is expressible as a 
function of the information components of said first 
sensor output signals, and a noise component associated 
with the operation of said further image sensor, a 
method of processing said first and further sensor 

35 output signals to reduce the noise components in said 
first sensor output signals and thereby derive noise- 
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reduced estimates of each of the information components 
within said first sensor output signals, said method 
conprising the steps of: 

(a) generating a first signal, 
representative of the information component within said 
further image sensor signal, as a function of said 
first sensor output signals; 

(b) generating a plurality of second signals 
representative of the noise variances associated with • 
the operation of said first image sensors and said 
further image sensor; and 

(c) combining the first and further sensor 
output signals produced by said first and further image 
sensors, respectively, with said first signal generated 

15 in step (a) and said plurality of second signals 

generated in step (b) , to obtain said noise-reduced 
estimates of the information ■ components of each of the 
information components within said first sensor output 
signals. 

20 

13 . A method according to claim 12 , wherein 
a respective one of said second signals is 
representative of the ratio of .the noise variance 
associated with the operation of a respective first 
25 iiriage sensor to a suipmation of the noise variances 
associated with the operation of said plurality of 
first image sensors and said further image sensor. . 



30 



35 



. . ^f - A niethbd according to claim 13, wherein 
said plurality of first image sensoirs '^r^^ first 
sensor output signals associated with respectively 
different color components of an image, and wherein 
step (a) comprises generating said first signal as a 
linear function of the respectively different^ color " 
representative first sensor output signals. 
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15. A method according to claim 14, wherein 
said further image sensor produces said further sensor 
output signal in accordance with a luminance component 
of said image, and wherein step (c) comprises 

5 generating a third signal as the difference between 
said first signal and said luminance component 
representative further sensor output signal and 
subtracting from said first sensor output signals 
respective combinations of said second and third 
10 signals. 

16. A method according to claim 15, wherein 
said plurality of first image sensors produce first 
sensor output signals R, G and B, respectively 

15 associated with red, green and blue color components of 
an image, and wherein step (a) comprises generating a 
first signal SI as a linear function of the respective 
red, green and blue color representative first sensor 
output signals, in accordance with the relationship: 

20 SI = aR + bG + cB, 

where a, b, and c are prescribed coefficients, 

17. A method according to claim 16, wherein, 
said further image sensor produces a further sensor 

25 output signal L in accordance with a luminance 

component of said linage, and wherein step (c) . conprises 
'!Vgenerat difference between ' 

s^id first signal SI, and said luminance, component, 

V representat output signal , ... ; 

18. A method according to claim 17, wherein, 
step (c) includes generating a plurality of second ; : * 
signals, a respective one of which is representative of : 

, the ratio of the. noise variance associated with . the 
.35 . operation of a respective first image sensor to a 
' summation of the noise variances associated with the 



BNSOOCID; <WO. „9109493A1 .l..> 



0 



wo 91/09493 



PCr/US90/07I42 



-22- 

operation of said plurality of first image sensors and 
said further image sensor; and combining the fir^t 
sensor output signals R, G and B produced by said first 
image sensors with said third signals and said 
plurality of second signals, to thereby obtain said 
noise- reduced estimates of the. information components 
of each of said first sensor output signals, 

19. A method according to claim . 18, wherein- 
a respective second signal, associated with one of said 
color contponents, is proportional to a product of a 
corresponding one of said coefficients and the ratio of 
the noise variance associated with the operation of a 
respective first image sensor to a siunmation of the 
15 noise variances associated with the operation of said 
plurality of first image sensors and said further image 
sensor. 



10 



20 



20. For use with a multiple color image 
sensor system having a plurality of first image 
sensors, each of which produces a respective first 
sensor output signal that contains a respective color 
representative component of said image and a noise 
conponent associated with the operation of the sensor 
25 through which its output signal is produced, and a 
further image sensor that produces a further sensor 
output signal containing a luminance representative 
component of said image, and which is ejqpressible as a 
fxinction of the. color components of said first sensor 
output signals, and a noise coirponent associated with 
the operation of said further image sensor, a method of 
processing said first and further sensor output signals 
to reduce the noise components in said first sensor 
output signals and thereby derive noise-reduced 
35 estimates of each of the color components within said 
first sensor output signals coifprising the steps of: 



30 
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(a) generating a first signal, 
representative of said further image sensor . signal, as 
a function of said first sensor output signals; 

(b) generating a second signal 

5 representative of a prescribed relationship between 
said first signal and said further sensor output 
signal; and 

(c) coiribining the first sensor output 
signals produced by said first image sensors with said 

10 second signal generated in step (b) , to obtain said 

noise-reduced estimates of the color components of each 
of said first sensor output signals. 

21. A method according to claim 20, wherein- 
15 step (b) comprises generating said second signal as the 

difference between said first signal and said further - 
sensor output signal, and wherein step (c) comprises 
subtracting a fraction of said second signal from each 
of said first sensor output signals to thereby obtain 
20 said noise-reduced estimates of the color contponents of 
each of said first sensor output signals. 

22. A method according to claim 20, wherein 
step (c) includes generating a plurality of third 

25 signals representative of the noise variances 

associated with the operation of said first image 
sensors and said further image sensor, and combining , . 
. .the first sensor output signals produced by said first; 
image sensors with the second signal generated in step , 
3d (it>j and said plurality of third signals, to thereby 
obtain said noise-reduced estimates of the color 
.components of each of said first sensor output signals. 

23. A method according to claim 22, wherein 
35 a respective one of said third signals is 

representative of .the ratio of the noise variance 
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associated with the operation of a respective first 
image sensor to a summation of the noise variances 
associated with the operation of said plurality of 
first image sensors and said further image sensor. 

24. A method according to claim 20, wherein 
step (a) comprises . generating said first signal as a 
linear function of the respectively different color 
representative first sensor output signals, and wherein 
step (b) coitprises generating said second sighal as the 
difference between said first signal and said luminance 
component representative further sensor output signal. 

25. A method according to claim 20, wherein 
15 said plurality of first image sensors produce first 

sensor output signals R, G and B, respectively 
associated with red, green and blue color con^onents of 
an image, and wherein step (a) conprises generating a 
first signal SI as a linear function of the respective 
red, green and blue color representative first sensor 
output signals, in accordance with the relationship: 

SI = aR + bG + cB, 
where a, b and c are prescribed coefficients, and 
wherein step (b) comprises generating a second signal 
25 S2 as the difference, between said first signal SI and 
said luminance component representative further sensor 
output signal. 



26. A method according, to claim 25, wherein: 
step (c) includes generating a pluraiity of third 
signals. S3, a respective one of which is representative 
of the ratio of the noise variance associated with the 
operation of a respective first image sensor to a 
summation of the noise variances associated with the 
35 operation of said plurality of first image sensors and 
said further image sensor, and combining the first 
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sensor output signals R, G and B produced by said first 
image sensors with the second signal S2 generated in 
step (b) and said plurality of third signals, to 
thereby obtain said noise-reduced estimates of the 
5 color components of each of said first sensor output 
signals. 

27, A method according to claim 26, wherein 
a respective third signal, associated with one of said 

10 color coirponents, is proportional to a product of a 

corresponding one of said coefficients and the ratio of 
the noise variance associated with the operation of a 
respective first image sensor to a summation of the- • 
noise variances associated with the operation of said 

15 plurality of first image sensors and said further image 
sensor. 
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